Optimal exploration as a symmetry breaking phenomenon
ثبت نشده
چکیده
We study the problem of joint estimation and control for a small example for which we can numerically compute the exact solution. We demonstrate, that optimal exploration is achieved through symmetry breaking in the Bellman equation; that optimal actions can be discontinuous in the beliefs; and that the optimal value function is typically non-differentiable. This could pose a challenge for the conventional design of value function approximations for solving POMDPs.
منابع مشابه
Optimal exploration as a symmetry breaking phenomenon
We study the problem of joint estimation and control for a small example for which we can numerically compute the exact solution. We demonstrate, that optimal exploration is achieved through symmetry breaking in the Bellman equation; that optimal actions can be discontinuous in the beliefs; and that the optimal value function is typically non-differentiable. This could pose a challenge for the ...
متن کاملPhase transitions and symmetry breaking in genetic algorithms with crossover
In this paper, we consider the role of the crossover operator in genetic algorithms. Specifically, we study optimisation problems that exhibit many local optima and consider how crossover affects the rate at which the population breaks the symmetry of the problem. As an example of such a problem, we consider the subset sum problem. In doing so, we demonstrate a previously unobserved phenomenon,...
متن کاملA scenario for symmetry breaking in Caffarelli-Kohn-Nirenberg inequalities
The purpose of this paper is to explain the phenomenon of symmetry breaking for optimal functions in functional inequalities by the numerical computations of some well chosen solutions of the corresponding Euler-Lagrange equations. For many of those inequalities it was believed that the only source of symmetry breaking would be the instability of the symmetric optimizer in the class of all admi...
متن کاملImproved Static Symmetry Breaking for SAT
An effective SAT preprocessing technique is the construction of symmetry breaking formulas: auxiliary clauses that guide a SAT solver away from needless exploration of symmetric subproblems. However, during the past decade, state-of-the-art SAT solvers rarely incorporated symmetry breaking. This suggests that the reduction of the search space does not outweigh the overhead incurred by detecting...
متن کاملStochastic incoherence in the response of rebound bursters
At an optimal value of the noise intensity, the maximum variability in rebound burst durations is observed and referred to as a response stochastic incoherence. A general mechanism underlying this phenomenon is given, being different from those reported so far in excitable systems. It is shown to be determined by (i) the monotonous reduction of the hysteresis responsible for bursting caused by ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2017